Capturing emotion reactivity through physiology measurement as a foundation for affective engineering in engineering design science and engineering practices

This paper presents the theoretical and practical fundamentals of using physiology sensors to capture human emotion reactivity in a products or systems engineering context.We aim to underline the complexity of regulating (internal and external) effects on the human body and highly individual physiological (emotion) responses and provide a starting point for engineering researchers entering the field. Although great advances have beenmade in scenarios involving human-machine interactions, the critical elements—the actions and responses of the human—remain far beyond automatic control, because of the irrational behavior of human subjects. These (re)actions, which cannot be satisfactorily modeled, stem mostly from the fact that human behavior is regulated by emotions. The physiological measurement of the latter can thus be a potential door to future advances for the community. In this paper, following a brief overview of the foundations and ongoing discussions in psychology and neuroscience, various emotion-related physiological responses are explained on the basis of a systematic review of the autonomic nervous systemand its regulation of the human body. Based on sympathetic and parasympathetic nervous system responses, various sensor measurements that are relevant in an engineering context, such as electrocardiography, electroencephalography, electromyography, pulse oximetry, blood pressure measurements, respiratory transducer, body temperature measurements, galvanic skin response measurements, and others, are explained. After providing an B Martin Steinert [email protected] Stephanie Balters [email protected] 1 Department of Engineering Design and Materials (IPM), Norwegian University of Science and Technology (NTNU), Trondheim, Norway overview of ongoing engineering and human-computer interaction projects, we discuss engineering-specific challenges and experiment setups in terms of their usability and appropriateness for data analysis. We identify current limitations associated with the use of physiology sensors and discuss developments in this area, such as software-based facial affect coding and near-infrared spectroscopy. The key to truly understanding user experience and designing systems and products that integrate emotional states dynamically lies in understanding and measuring physiology. This paper serves as a call for the advancement of affective engineering research.